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CLAIM AMENDMENTS 
Claim Amendment Summary 
Claims pending 

• At time of the Action: Claims 1-61. 

• After this Response: Claims 1, 2, 4-7, 9, 10, 12, 13, 15, 16, 18-24, 
32, 34, 35, 37, 38, 40, 41-43, 47-48, 51, 52, 54, and 56-61. 

Canceled or Withdrawn claims: 3, 8, 11, 14, 17, 25-31, 33, 36, 39, 44- 
46, 49-50, 53, and 55. 

Amended claims: 1, 2, 4, 6, 7, 9, 10, 13, 15, 16, 18, 19, 34, 35, 37, 38, 40, 
41,51,52, and 54. 

New claims: none. 

Claims: 

1. (Currently AMENDED) A method of determining language usage 
probabilities of a natural language based upon a training corpus, the method 
comprising: 

examining a training corpus, wherein such corpus includes phrases parsed 
in accordance with a set of grammar rules; 

computing probabilities of usage of combinations of linguistic features 
based upon empirical tracking of appearances of instances of such combinations in 
phrases within the training corpus; 

wherein the co mbinatiQns Qf linguistic features consist of: 

• ( transition- headword, phrase level, syntactic history. se^tvpeV 
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• /liefi4worcL phrase levi^, syntactic history se^typeV 

• f modifying h eadword, transition, headwords or 

• (transiti ng, headword^ 

(CURRENTLY AMENDED) A method o f deteirmnfafl language usaflc 
I |flnpift ffe based upon a training corpus, the method 

examining a traini ng corp us, wherein such cor pus include s phrases parsed 
in ar.mrd aTir.ft with a set of grammar rules: 

computing probabilities of usage of combinations of linguistic features 
based upon emp irical tracking of appearance? pf instan ces of such combinations in 
phrases within the training corpus: 

A method ao rooitod in okam^ wherein the combinations of linguistic 
features comprises; 

• (transition, headword, phrase level, syntactic history, segtype); 

• (headword, phrase level, syntactic history, segtype); 

• (modifying headword, transition, headword); and 

• (transition, headword). 

3. (Canceled) 
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4. (Currently Amended) A ' method as rotitod in claim 1, A 

meth od of determininfl lanfluape usage probabilities_of a natural language based 
upon attaining corpus, th e mptfepd comprising: 

examining a trp inin p corpus T wherein suc h corpus includes ph rases parsed 
in acpordance with a set of g ra mmar rules: 

computing probabilities of usape of combinations of linguistic features 
based upon empirica l trackin g of appearances of in stance^ of such combinations in 
phrases within the training corpus, wherein the computing comprises counting 
appearances of instances of combinations of linguistic features within the training 
corpus. 

5, (ORIGINAL) A computer-readable storage medium having 
computer-executable instructions that, when executed by a computer, performs the 
method as recited in claim 1 . 
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6. (CURRENTLY AMENDED) A method for determining a probability 
at a node in a parse tree, the method comprising: 

receiving language-usage probabilities based upon appearances of instances 
of combinations of linguistic features within a training corpus; 

calculating the probability at the node based upon linguistic features of the 
node and the language-usage probabilities; 

whe rein the com binations of linguistic features consist of: 

• (transition , headword, phrase fc vel, ^Y ntact i c history, se^tvpe^t 

• fheadword. phrase level, syntactic h|?torv. seetypeV 

• (modifying headword, transition, h eadword): or 

• ftransition, headwords 

7. (Currently Amended) A met hod for detern^ pins a probability 
at a nqfle in a parse tr ee, the meth od comprising: 

receivingJLanguage-usage probabilities based irpoq appearances of instances 
of g gmbinations of linguistic features within a trainin g corpus: 

calculating the probability at the node based up on, lin guistic features of the 
node and the language -usage probabilities: 

A" meth o d ao recited in claim 6, w herein the combinations of linguistic 
features comprises: 

• (transition, headword, phrase level, syntactic history, segtype); 

• (headword, phrase level, syntactic history, segtype); 

• (modifying headword, transition, headword); and 

• (transition, headword). 
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8, (Canceled) 

9* (CURRENTLY AMENDED) A method for deten ^iminp a probability 
at a node in a parse tree, th e m ethod comprising: 

receiving Jftnguafle-usafle probabilities based upon anrt 
of combinations of linguistic featu res within a training corpus: 

calculating the probability at the node based upon linguisticJfi 
node an4 foe lan guage-usage proba b i ^^^S T A method ao rooitorikm claim 6. 
wherein the calculating comprises using PredParamRule Probability formula to 
calculate the probability at the node. 

10. (CURRENTLY AMENDED) A method for determining a probability 
^La nodeJn a parse tree, the method comprising: 

receiving langu age-usa ge probabilities based upon appearan ces of instances 
of combinfrtiQ fl s of linguistic features within a training corpus: 

calculating the nr g fofailitv a t the node based upon linguistic features of the 
node an<j the language-usage probabilities. A» " mothod aa recited in claim 6. 
wherein the calculating comprises using both PredParamRule Probability and 
SynBigram Probability formulas to calculate the probability at the node. 

11* (Canceled) 



Serial No.: 09/620,745 

Atty Docket No.: MS1-543US 

RESPONSE TO NON-FINAL OFFICE ACTION DATED 
6/10/2004 



03 J 10*1255 G;\MSf-Cl543uBlM$r-S43u&ma2.dcc 
atty: Kauyc cmtetfe 



PAGE 8/25 * RCVD AT 811112004 5:07:27 PM [Eastern Daylight Time] ' SVR:USPTO€FXRF-1/0 * DNIS:8729306 • CSID:509 323 8979 ' DURATION (mm-ss):0644 



PUG 11 2004 14:22 FR LEE - HAYES PLL 509 323 8979 TO 17038729306 P. 09/25 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 

S 16 
in 

"-Iks i 17 
!1B8| 




12. (ORIGINAL) A computer-readable storage medium having 

computer-executable instructions that, when executed by a computer, performs the 
method as recited in claim 6. 

13* (Currently Amended) A method for determining a statistical 
goodness measure (SGM) of a parse tree representing a parse of a phrase, the 
parse tree comprising one or more nodes, the method comprising: 

combining probabilities of each node in the parse tree, wherein the 
probabilities of each node are determined by the steps comprising: 

receiving language-usage probabilities based upon appearances of 

instances of combinations of linguistic features within a training corpus; 

calculating the probabilities of each node based upon linguistic 

features of each node and the language-usage probabilities; 

wherein the combinations of linguistic features comprises: 

• (transition, headwords jphiaseifiyel- syntactic history, set 

• (headword, nhrase level, syntactic history sefrftypeV 

• (modifying headword, transition, headword^: and 

• (transition, headword^ 

14. (Canceled) 
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15. (CURRENTLY AMENDED) A meft ind for determining a statical 
sure /SGM^ of a parse tree__r epresentiTig a parse of a phrase, the 

parse tree co mprising one or more nodes, the method comprising: 

combining probabilities of each node in the pars e tree T ^herein the 
prohah^tie s of each nod e are determined bv the steps comprising: 

receiving language-usage probabilities based upon appearances of 
instances of cor nhinqtions of linguistic features wiftftfo & training corpus: 

calculating the probabilities of each node bas ed upon linguistic 
features of ea c h node and the language-usage p robabilities , A method an 
recited in cla i rr^- 13, wherein the calculating comprises using 
PredParamRule Probability formula to calculate the probability at the node. 

16. (CURRENTLY AMENDED) A method for determining a statistical 
goodness measure fSGlVfi of a par^e tree r epresenting a parse of a phrase, the 
parse tree comprising onq or mo re nodes, the method comprising: 

combining probabilities of each node in the parse tree, wherein „ the 
probabilities of each node are de^err-pined bv the steps comprising: 

receiving language-usage probabilities based u pon appearances of 
ip&tanges_of co mbinations of linguistic features within a training corpus: 

calculating the r g prq babilities of each pode Jba5e t d . jup pr^ 
features of each node and the language-usage probabilities. A - mothod - as 
rec i ted i n claim 13/ wherein the calculating comprises using both 
PredParamRule Probability and SynBigram Probability formulas to 
calculate the probability at the node. 
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17, (Canceled) 

18. (Currently Amended) A method for determining statistical 
goodness measures (SGMs) of multiple parse trees, each tree representing a 
syntactically valid parse of a phrase, the method comprising determining a SGM 
of each parse tree by the method ao rooitod in claim 13 a method comprising: 

combinin g probabilities of e ach node in the parse tre e, wherein the 
probabilities of each node are determined bv the steps C9 mprising: 

receiving latifTiifl ffe-iisage probabilities b ased upo n appearangSS_of 
instances of combinations of linguistic features within a training corpus: 

calculating the probabilities of each node based u pon linguistic 
features of each node and the language-usag e probabilities. 

19* (Currently Amended) A method for ranking multiple parse 
trees, each tree representing a syntactically valid parse of a phrase, the method 
comprising: 

determining statistical goodness measures (SGMs) of each parse tree by a 
statistical goodness measure fSGNf) method the method ao recited in claim 13 to 
get an SGM values associated with each tree; 

organizing the trees in order of each tree's associated SGM value; 

the SGM method comprising: 

combining probabilities of each node in the parse tre^ fflfierein_thg 

probabilities of each node are detennjne_d_bv the steps comprising; 
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• receivir^ lanpuage-usage proba bilities based upon appearances 
of instances of combinations of liTjpiiistic features within a 
trainin g corpus; 

• calqilatinff the probab il^^ of each node based irpon linguistic 
features of each node and t he lan guage-usage probabilities, 

20. (ORIGINAL) A computer-readable storage medium having 
computer-executable instructions that, when executed by a computer, performs the 
method as recited in claim 13. 

21. (ORIGINAL) A method of parsing a phrase to facilitate processing 
of such phrase by a computer, the method comprising: 

generating at least one parse tree representing a syntactically valid parse of 
the phrase, wherein the parse tree has hierarchical nodes; 

dividing each node into one or more hierarchical phrase levels, wherein the 
phrase levels at a node represent a set of possible transitions from such node that 
are allowed by a set of grammar rules. 

22. (Original) A method as recited in claim 21, wherein the set of 
possible transitions from each node consists of all possible transitions from such 
node that are allowed by a set of grammar rules. 



Serial No.* 09/620 745 * 

Atty Docket No.: MS1-543US 10 M7l047&aiM$7-&&3wWS7-$*3tamazttoc 

RESPONSE TO NON-FINAL OFFICE ACTTON DATED «V C CNblte 

6V10/2004 

AT 8/1 1/2004 5:07:27 PM [Eastern Daylight Time] * SVR:USPTO-EFXRM/0 * DNIS:8729306 * CSID:509 323 8979 * DURATION (mm-ss):0M4 



AUG 11 2004 14:23 FR LEE - HAYES PLL 509 323 8979 TO 17038729306 P. 13/25 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 

g 16 
g $ cM cm m - 



-, : 20 




25 



23. (Original) A method as recited in claim 21, wherein the set of 
possible transitions from each node includes a null transition representing an 
application of none of the grammar rules, 

24. (Original) A computer-readable storage medium having 
computer-executable instructions that, when executed by a computer, performs the 
method as recited in claim 21. 

25. (Canceled) 

26. (Canceled) 

27. (Canceled) 

28. (Canceled) 

29. (Canceled) 

30. (Canceled) 

31. (Canceled) 
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32* (ORIGINAL) A computer-readable storage medium having 

computer-executable instructions that, when executed by a computer, perform a 
method to rank multiple parse trees, each tree representing a syntactically valid 
parse of a phrase, the method comprising; 

generating at least one parse tree representing a syntactically valid parse of 
the phrase, wherein the parse tree has hierarchical nodes; 

dividing each node into one or more hierarchical phrase levels, wherein the 
phrase levels at a node represent a set of possible transitions from such node that 
are allowed by a set of grammar rules. 

33* (CANCELED) 

34. (Currently AMENDED) An apparatus comprising; 
a processor; 

a natural-language-usage probability determiner executable on the 
processor to: 

examine a training corpus, wherein such corpus includes phrases 
parsed in accordance with a set of grammar rules; 

compute probabilities of usage of combinations of linguistic features 
based upon empirical tracking of appearances of instances of such 
combinations in phrases within the training corpus; 

wherein the combinations of linguistic features consist of: 

• (transition, headword, phrase level, syntact ic history, 
sefttype); 

• (headword, phrase level, syntactic history segtvpe^: 
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» (ipodifving headword, ftansition. head words or 
♦ ^transition. headwordV 

35. (CURRENTLY AMENDED) An apparatus comprising; 
a processor: 

a natural-language-usage probability determiner executable on the 
processor to: 

examine a training corpus, wherefa^ such corpus includes phrases 
parsed in ac cordance with a set of grammar rules: 

compute pr^ ^bilities of usage of combinatio ns of %fi uistic features 
based upon e m pirical tracking of appearan ces of instances oL such 
conizations in phrases within the training pQ^us: 

Ao - appoiatuD no recited in claim 31, w herein the combinations of 
linguistic features comprises: 

• (transition, headword, phrase level, syntactic history, segtype); 

• (headword, phrase level, syntactic history, segtype); 

• (modifying headword, transition, headword); and 

• (transition, headword). 

36. (Canceled) 
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37. (Currently Amended) An apparatus comprising: 

a processor, 

a natural-language-usage probability determiner executable on the 
processor to: 

receive language-usage probabilities based upon appearances of 
instances of combinations of linguistic features within a training corpus; 

calculate a probability at a node in a parse tree based upon linguistic 
features of the node and the language-usage probabilities; 

wfre p-ein the combinations of linguistic fe atures consist of: 

■ (transition, headword, phrase level, syntactic __histor\L 
segtypeV 

• (headword, p hp^ fr fcvel. syntactic history. segtvoeV- 

• (modifvingjiegdword, transit 

• (transiting >|fifldwnrdV 



38, (Currently Amended) 

a processor: 
a namral-language-jus.q^e_jamb ability del 



AiLaPDaiflt iifi comprising: 



ihle on the 



processor to: 

receive langu ape- u sa pe probabilities based vpc^_^^mmic^jjf 
instances of combinations of linguistic features within a training corpus: 

calculate a probability at a node in a parse tree based upon linguistic 
features of the node and the language-usage probabilities: 
Atrapp ft mto^^i^ 37 ' , wherein the combinations of linguistic 

features comprises: 
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• (transition, headword, phrase level, syntactic history, segtype); 

• (headword, phrase level, syntactic history, segtype); 

• (modifying headword, transition, headword); and 

• (transition, headword). 



39. (Canceled) 



An apparatus comprising: 



40. (Currently Amended) 

a processor: 

a natural-language-usage p robability determiner executable on the 
processor to: 

receive lan ftuape-usage prob abilities based upon appearances of 
instances of combi nations of linguistic features within a training corpus: 

calculate a probq frifcty at a node in a parse t ree based upon l inguistic 
features of the node and the languae e-usage probabilities: 
A tt' QppnmtuG as recited in claim 37, wherein the determiner calculates the 
probability at the node by using PredPaiamRule Probability formula. 
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41. (Currently Amended) An apparatu s cc^prisin^: 

a processor: 

a natural-Ian &uage-usage p y pbabilitv determiner exec utable on the 
GEQcessor to: 

receive language-usage probab ilities frased upon appearances of 
^stances of combinations of li nguistic features within a training corpus: 

calculate a probability at a node in a parse tree based upon linguistic 
feat ures of the node and the lanpuas*e-i^gp probabilities: 
An apparatuo as rooitod In claim 37, wherein the determiner calculates the 
probability at the node by using both PredParamRule Probability and SynBigram 
Probability formulas. 

42. (Original) An apparatus comprising: 
a processor; 

a natural-language-usage parser executable on the processor to: 
generate at least one parse tree representing a syntactically valid parse of 
the phrase, wherein the parse tree has hierarchical nodes; 

divide each node into one or more hierarchical phrase levels, 
wherein the phrase levels at a node represent a set of possible transitions 
from such node that are allowed by a set of grammar rules. 

43. (ORIGINAL) An apparatus as recited in claim 42, wherein the set of 
possible transitions from each node includes a null transition representing an 
application of none of the grammar rules. 
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44. (Canceled) 
45* (Canceled) 
46* (Canceled) 

47* (ORIGINAL) A data structure for use with a computer having a 
processor and a memory, said structure comprising: 

a corpus comprising one or more phrases in a natural language; 

parse trees having hierarchical nodes, each tree representing at least one 
syntactically valid parse of each phrase in a subset of the corpus; 

wherein each node has one or more hierarchical phrase levels, wherein the 
phrase levels at a node represent a set of possible transitions from such node that 
are allowed by a set of grammar rules. 

48. (Original) The structure as recited in claim 47 3 wherein the subset 
of the corpus includes all phrases in the corpus. 

49. (Canceled) 

50. (Canceled) 
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51. (Currently Amended) A data structure for use with a computer 
having a processor and a memory, said structure comprising: 

a corpus comprising one or more phrases in a natural language; 

parse trees having hierarchical nodes, each tree representing at least one 
syntactically valid parse of each phrase in a subset of the corpus; 

wherein each node as an associated probability, wherein the associated 
probability of a node is based upon linguistic features of such node and language- 
usage probabilities derived from appearances of instances of combinations of 
linguistic features within a training corpus; 

wherein PredParamRuIe probability., formula is used to calculate a 
probability associated with a node . 

52, (CURRENTLY AMENDED) A data structure for use with a computer 
having a processor and a memory, said structure comprising: 

a corpus comprising one or more ph rases in a natural lan^ua^e ; 

pa^^e^SLJl^YinfiJhkmr chical nodes, each tr ee representing at least one 
syntactically valid parse of eachphrase in a subset of the, iaoipufc 

wherein each node as an associated probability, wherein the -associated 
probability of a node is based upon linguistic features of such node and language- 
usage probabilities derived from appearances of instances of combinations of 
linguistic featur9s ii ^i ^bin_a_training corpus: 

A me th od ao recited in claim 51, wherein the combinations of linguistic 
features comprises: 

• (transition, headword, phrase level, syntactic history, segtype); 

• (headword, phrase level, syntactic history, segtype); 
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• (modifying headword, transition, headword); and 

• (transition, headword). 

53. (Canceled) 

54. (Currently Amended) A data structure for tjge withLauoomputer 
havin g a processor an d a memory, said structure comprise: 

a corpus comprising one or more p leases in a natural language: 

parse treesJhaving hierarchical nodes, each .t yy? representing at least one 
syntactically valid parse of each phrase in a subset of the corpus: 

wherein each node as_an associate d probability, wherein the associated 
probability of a node is based noon linguistic features of sucpfr T^ode and language- 
usage probabilities derived ftopi apjagaranc.es of instances of combinations of 
lin guistic features within a training corpus: 

A method ao rooitod M iTh - ola»m - 54 ^ wherein both PredParamRule Probability 
and SynBigram Probability formulas are used to calculate a probability associated 
with a node. 

55. (Canceled) 

56. (ORIGINAL) A program module for execution on a computing 
operating environment having a memory, the module comprising: 

a natural language phrase parser configured to generate one or more 
syntactically valid parses for a phrase, each parse may be represented by a parse 
tree having hierarchical nodes; 
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a parse ranker configured to calculate a SGM for each parse of a phrase and 
to rank the parses to indicate a most probable parse; 
wherein the parse ranker comprises: 

data-acquisition device for receiving language-usage probabilities 
based upon appearances of instances of combinations of linguistic features 
within a training corpus; 

probability calculator for calculating a probability at a node of a 
parse tree based upon linguistic features of the node and the language-usage 
probabilities. 



57. (ORIGINAL) A natural language processing system comprising a 
program module as recited in claim 56* 

58. (ORIGINAL) A grammar checking system comprising a program 
module as recited in claim 56. 

59. (Original) A speech processing system comprising a program 
module as recited in claim 56. 

60. (ORIGINAL) A database query processing system comprising a 
program module as recited in claim 56. 



6L (ORIGINAL) An operating system comprising a program module as 
recited in claim 56. 
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